Systems and methods for utilizing a living entity as a marker for augmented reality content

ABSTRACT

Systems and methods for utilizing living entities as markers for virtual content in an augmented reality environment are discussed herein. The virtual content may comprise objects, surfaces, textures, effects, and/or other content visibly manifested in views of the augmented reality environment. In some implementations, the virtual content may comprise an avatar and/or other full- or partial-body virtual content object depicted based on the living entity. A living entity and multiple linkage points for the living entity may be detected within the field of view of a user. Based on the arrangement of the linkage points, virtual content may be rendered and appear superimposed over or in conjunction with a view of the living entity in the augmented reality environment. In some implementations, the rendering of virtual content in the augmented reality environment may be triggered by the arrangement of the multiple linkage points for a given living entity.

FIELD OF THE INVENTION

The systems and methods described herein relate to presenting virtualcontent in an augmented reality environment.

BACKGROUND

Augmented reality environments may be used to present virtual content tousers as if it were present in the real world.

SUMMARY

The systems and methods described herein may facilitate the rendering ofvirtual content in an augmented reality environment based on livingentities serving as markers for the virtual content. An augmentedreality environment may include views of images forming virtual contentsuperimposed over views of the real world. Virtual content may berendered by a display device in an augmented reality environment basedon the field of view seen through the display device. The virtualcontent may comprise objects, surfaces, textures, effects, and/or othercontent visibly manifested in views of the augmented realityenvironment. In some implementations, virtual content may comprise anavatar and/or other full- or partial-body virtual content objectdepicted based on the living entity. In various implementations, aliving entity and multiple linkage points for the living entity may bedetected within the field of view of a user. Based on the arrangement ofthe linkage points, virtual content may be rendered and appearsuperimposed over or in conjunction with a view of the living entity inthe augmented reality environment. In some implementations, therendering of virtual content in the augmented reality environment may betriggered by the arrangement of the multiple linkage points for a givenliving entity. For example, the arrangement of the multiple linkagepoints may indicate a state or action of the living entity at a giventime. Virtual content may be rendered in the augmented realityenvironment based on the state or action of the living entity.

In various implementations, the system described herein may beconfigured to render virtual content in an augmented reality environmentbased on a living entity, in accordance with one or moreimplementations. The system may include one or more of an interface, oneor more physical processors, electronic storage, a display device, animaging sensor, and/or other components.

The one or more physical processors may be configured bycomputer-readable instructions. Executing the computer-readableinstructions may cause the one or more physical processors to rendervirtual content in an augmented reality environment based on livingentities serving as markers for the virtual content. Thecomputer-readable instructions may include one or more computer programcomponents. The computer program components may include one or more of auser interface component, a content management component, a contenttriggering component, an image generation component, a display controlcomponent, and/or other computer program components. The one or morephysical processors may be physically located within a user deviceand/or within any of the other components of the system. For example,the user device may comprise the display device and/or becommunicatively coupled to the display device. The one or more physicalprocessors may represent processing functionality of multiple componentsof the system operating in coordination. Therefore, the variousprocessing functionality described in relation to the one or moreprocessors may be performed by a single component or by multiplecomponents of the system.

The content management component may be configured to manage virtualcontent to be rendered in an augmented reality environment. For example,the content management component may be configured to obtain, download,upload, modify, remove, and/or otherwise manage information storedand/or accessible by the system. The information may include virtualcontent information. Virtual content information may define virtualcontent (or a set of virtual content), a reference frame of the virtualcontent, a correlation between the reference frame of the virtualcontent and one or more linkage points defined with respect to a livingentity (i.e., the arrangement of the multiple linkage points), and/orother information related to the virtual content. The linkage points mayserve as an anchor for the reference frame of virtual content. As such,when rendered in an augmented reality environment by the display device,the virtual content may appear within a user's field of view based onhow the reference frame of the virtual content is correlated to the realworld by virtue of the position of the linkage points in the real world.In various implementations, the virtual content information may comprisetriggering information for virtual content (e.g., a virtual content itemor a set of virtual content). For example, the triggering informationmay indicate an arrangement of linkage points defined with respect to aliving entity, a state of a living entity, and/or an action of a livingentity that prompt virtual content to be rendered in the augmentedreality environment when the arrangement of linkage points, state of theliving entity, and/or action of the living entity is detected and/oridentified.

The content management component may be configured to obtain virtualcontent information. For example, the content management component maybe configured to obtain virtual content information from electronicstorage, from one or more devices of the user, one or more connecteddevices (e.g., a device of a living entity visible within a field ofview of the user), and/or via a network (e.g., via the Internet, cloudstorage, and/or one or more other networks). In various implementations,the content management component may be configured to receive anindication of an arrangement of linkage points, a particular state of aliving entity, and/or a particular action of a living entity and obtaincorresponding virtual content information.

The content triggering component may be configured to trigger images ofvirtual content to be rendered in an augmented reality environment. Invarious implementations, the content triggering component may beconfigured to detect a living entity and multiple linkage points for theliving entity visible within the field of view of a user. For example,the content triggering component may be configured to detect a livingentity and one or more linkage points for the living entity visiblewithin the field of view of a user based on a transponder of the livingentity. Based on the arrangement of the linkage points, the contenttriggering component may be configured to cause the content managementcomponent to obtain virtual content information defining particularvirtual content that is to be displayed when the arrangement is presentand cause the image generation component to generate an image of theparticular virtual content to be displayed in the augmented realityenvironment.

In some implementations, the content triggering component may beconfigured to trigger images of virtual content to be rendered in anaugmented reality environment based on information received from aliving entity. For example, the content triggering component may beconfigured to receive triggering information from a transponder of theliving entity, a wearable device of the living entity (e.g., a visor orglasses in the case of a human and/or a collar in the case of ananimal), a user device (e.g., a smart phone), and/or other device of theliving entity. In some implementations, the triggering informationreceived from the living entity may cause virtual content unique to theliving entity to be rendered in an augmented reality environment. Forexample, the triggering information may be provided with, or prompt thecontent management component to obtain, virtual content informationdefining virtual content to be displayed based on the living entity(e.g., virtual content information defining virtual content unique tothe living entity). In some implementations, the living entity and/oranother user associated with the living entity may specify the virtualcontent to be displayed based on the living entity. In other words, theliving entity may choose which virtual content is to be displayed orsuperimposed an image of them via the display device of the user.

The linkage points associated with a living entity may serve as ananchor for the reference frame of virtual content. As such, the positionof the linkage points in the real world may define the reference frameof virtual content with respect to the real world. In someimplementations, the linkage points may be defined with respect to theliving entity. In some implementations, the linkage points may belocated on one or more items worn by and/or affixed to the livingentity. For example, one or more linkage points may be defined withrespect to a device (e.g., a visor or glasses) or item (e.g., jacket orcollar) worn by the living entity. The linkage points may be defined byone or more body parts of the living entity.

The content triggering component may be configured to utilize one ormore image recognition techniques to detect a living entity and one ormore linkage points for the living entity visible within the field ofview of the user. For example, the content triggering component may beconfigured to detect a living entity visible within the field of view ofthe user by comparing a first image of the series of images captured ata first point in time and a second image of the series of imagescaptured at a second point in time. In some implementations, the contenttriggering component may be configured to detect a living entity withina proximity of the user based on audio information received by thesystem. For example, audio information received may indicate thepresence of a living entity within a proximity of the user, locationinformation for the living entity, and/or other information of theliving entity. The content triggering component may be configured todetect linkage points for the living entity visible within the field ofview using facial and/or body recognition techniques, by identifying oneor more body parts of the living entity, by detecting clothing or itemsworn by living entity configured to serve as linkage points for virtualcontent, by detecting one or more specific colors or sound patterns,and/or using one or more other image recognition techniques capable ofdetecting linkage points for the living entity visible within the fieldof view of a user.

The content triggering component may be configured to determine anarrangement of the linkage points detected for a given living entity.The arrangement of linkage points may define the position of the linkagepoints in relation to one another. In other words, the arrangement ofthe linkage points may define the relative position of each of thelinkage points. In some implementations, the content triggeringcomponent may be configured to determine an arrangement of the linkagepoints detected for each of the multiple living entities simultaneously.In some implementations, the content triggering component may beconfigured to trigger images of virtual content to be rendered in anaugmented reality environment based on the arrangement of the linkagepoints defined with respect to the living entity. The virtual contentinformation obtained may define the virtual content item to be displayedwhen the arrangement is present, in addition to at least a correlationbetween the arrangement and a reference frame of the virtual contentitem.

The content triggering component may be configured to identify a stateof the living entity or an action of the living entity based on thearrangement of the linkage points at one or more points in time. A stateof a living entity may refer to the physical state of the living entityat a given point in time. For example, the state of a living entity maybe standing, sitting, laying down, and/or one or more other currentphysical states of the living entity. An action of a living entity mayrefer to a physical action of the living entity at a given time. Forexample, the action of a living entity may be running, standing up,sitting down, walking, jumping, acts of intimacy, and/or one or moreother actions of the living entity. In some implementations, the contenttriggering component may trigger images of virtual content to berendered in an augmented reality environment based on the identifiedstate or action of the living entity.

The content triggering component may be configured to identify theliving entity. The identification of the living entity may compriseidentification of a specific living entity (i.e., a specific user and/orspecific pet), a type of living entity (e.g., a specific species, aspecific subset of a species, and/or other type of living entity), apredefined group of living entities (e.g., family, friends, co-workers,and/or other group of living entities associated with the user), and/orother one or more other identifications of the living entity. Eachliving entity, type of living entity, and/or group of living entitiesmay be associated with specific virtual content. In someimplementations, the content triggering component may trigger images ofvirtual content to be rendered in an augmented reality environment basedon the identification of the living entity.

The image generation component may be configured to generate an image ofvirtual content to be displayed in an augmented reality environment. Invarious implementations, the image generation component may beconfigured to generate an image of virtual content to be displayed in anaugmented reality environment based at least on a user's field of viewand virtual content information (i.e., information defining at least thevirtual content and a reference frame of the virtual content).

A user's field of view may be defined based on orientation information,location information, and/or other information. The orientationinformation may define an orientation of the display device. Forexample, the orientation of display device may be defined by one or moreof a pitch angle, a roll angle, a yaw angle, and/or other measurements.When looking through the display device, the orientation of displaydevice may indicate the direction of a user's gaze. The locationinformation may identify a physical location of the display device. Bydetermining the direction of a user's gaze and the user's physicalposition in the real world, a user's field of view may be determined.

The image generation component may be configured to generate an image ofvirtual content to be displayed in the augmented reality environmentbased on the arrangement of linkage points. That is, the imagegeneration component may be configured to generate an image of virtualcontent based on a correlation between linkage points and the referenceframe of the virtual content. In some implementations, the imagegeneration component may be configured to generate an image of virtualcontent based on the size of the arrangement of the multiple linkagepoints within the field of view of the user and/or the distance of theliving entity from the user. The image generation component may beconfigured to automatically generate images of the virtual content as auser's field of view changes or as a living entity moves within a user'sfield of view, thus changing the depiction of the virtual content in theaugmented reality environment based on the reference frame of thevirtual content and its correlation to the position of the linkagepoints.

The display control component may be configured to cause an imagegenerated by image generation component to be displayed in an augmentedreality environment via a display device. The display control componentmay be configured to effectuate transmission of instructions to thedisplay device to cause the image to be displayed. Images of virtualcontent generated by image generation component may be presented via adisplay device in conjunction with the real world so that the virtualcontent appears as if it exists in the real world. The display controlcomponent may be configured to cause updated images of virtual contentto be displayed in the augmented reality environment via a displaydevice in real-time.

These and other objects, features, and characteristics of the systemand/or method disclosed herein, as well as the methods of operation andfunctions of the related elements of structure and the combination ofparts and economies of manufacture, will become more apparent uponconsideration of the following description and the appended claims withreference to the accompanying drawings, all of which form a part of thisspecification, wherein like reference numerals designate correspondingparts in the various figures. It is to be expressly understood, however,that the drawings are for the purpose of illustration and descriptiononly and are not intended as a definition of the limits of theinvention. As used in the specification and in the claims, the singularform of “a”, “an”, and “the” include plural referents unless the contextclearly dictates otherwise.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates a system for rendering a virtual content object in anaugmented reality environment based on a living entity, in accordancewith one or more implementations.

FIG. 2 illustrates an exemplary correlation between an arrangement oflinkage points defined with respect to a living entity and a referenceframe of a virtual content item, in accordance with one or moreimplementations.

FIG. 3A and FIG. 3B illustrate exemplary displays of an augmentedreality environment including virtual content rendered based on a livingentity, in accordance with one or more implementations.

FIG. 4A and FIG. 4B illustrate exemplary displays of an augmentedreality environment including virtual content rendered based on multipleliving entities simultaneously, in accordance with one or moreimplementations.

FIG. 5A, FIG. 5B, and FIG. 5C illustrate exemplary displays of anaugmented reality environment including virtual content rendered basedon a non-human living entity, in accordance with one or moreimplementations.

FIG. 6 illustrates a method for rendering a virtual content object in anaugmented reality environment based on a living entity, in accordancewith one or more implementations.

DETAILED DESCRIPTION

This disclosure relates to systems and methods for utilizing livingentities as markers for virtual content in an augmented realityenvironment, in accordance with one or more implementations. Virtualcontent may refer to one or more virtual content items. A virtualcontent item may comprise a two- or three-dimensional virtual image ofan object, a part of an object, a surface, a texture, an effect, and/orother content visibly manifested in views of the augmented realityenvironment. In some implementations, virtual content may comprise anavatar and/or other full- or partial-body virtual content objectdepicted based on the living entity. The living entities used as amarker by the systems and methods disclosed herein may be human and/orof one or more other species (e.g., a dog, a cat, and/or one or moreother species). Virtual content may be rendered by a display device inan augmented reality environment based on the field of view seen throughthe display device and a position of linkage points of the living entityin the real world.

In some implementations, the techniques described herein may be used torender virtual content in an augmented reality environment based on theuser. That is, a display device of a user may render virtual contentbased on one or more living entities within field of view of the userwhile the user and/or the one or more living entities simultaneouslyvisualize virtual content based on the user. In other words, thetechniques described herein may be used by individual users to viewvirtual content depicted in association with or superimposed over boththemselves and one or more living entities within their field of view.For example, the techniques described herein may enable a user to lookdown at their own hand and see virtual content superimposed over theirhand based on the detection of linkage points of the hand and virtualcontent information defining virtual content to be rendered over thehand.

It will be appreciated by those having skill in the art that theimplementations described herein may be practiced without these specificdetails or with an equivalent arrangement. In other instances,well-known structures and devices are shown in block diagram form inorder to avoid unnecessarily obscuring the implementations of theinvention.

Exemplary System Architecture

FIG. 1 illustrates a system 100 for rendering a virtual content objectin an augmented reality environment based on a living entity, inaccordance with one or more implementations. The system may include oneor more of interface 102, one or more physical processors 110,electronic storage 130, display device 140, imaging sensor 150, and/orother components.

The one or more physical processors 110 (also interchangeably referredto herein as processor(s) 110, processor 110, or processors 110 forconvenience) may be configured to provide information processingcapabilities in system 100. As such, the processor(s) 110 may compriseone or more of a digital processor, an analog processor, a digitalcircuit designed to process information, a central processing unit, agraphics processing unit, a microcontroller, an analog circuit designedto process information, a state machine, and/or other mechanisms forelectronically processing information.

Processor(s) 110 may be configured to execute one or more computerreadable instructions 112. Computer readable instructions 112 mayinclude one or more computer program components. Computer readableinstructions 112 may include one or more of user interface component114, content management component 116, content triggering component 118,image generation component 120, display control component 122, and/orother computer program components. As used herein, for convenience, thevarious computer readable instructions 112 will be described asperforming an operation, when, in fact, the various instructions programthe processor(s) 110 (and therefore system 100) to perform theoperation.

User interface component 114 may be configured to generate and cause auser interface to be displayed to a user. In various implementations,the user interface may be displayed to a user via a display interface ofa user device. For example, a user interface may be displayed to a uservia a graphical user interface of a user device, a display of displaydevice 140, or any other display interface provided via a user deviceand/or a component of system 100.

In various implementations, user interface component 114 may beconfigured to generate a user interface that provides a user withinformation related to system 100. For example, the information relatedto the system may comprise an indication of one or more connecteddevices (e.g., a user device such as a smartphone or display device,and/or other devices connectable to system 100), virtual contentdepicted in the augmented reality environment whether currently visibleor not, virtual content available to be presented via display device 140(e.g., content available via one or more devices of a user, electronicstorage 130, and/or other components of system 100), an indication of adirection in which virtual content may be visible via display device140, an indication of one or more markers visible via display device140, an indication of one or more living entities visible via displaydevice 140, one or more instructions for the user to trigger therendering of virtual content in the augmented reality environment viadisplay device 140, an indication of one or more other users interactingwith and/or viewing virtual content, a current time and/or date, and/orother information related to system 100. In some implementations, userinterface component 114 may be configured to generate a user interfacethat provides a user with information related to system 100 withoutenabling the user to provide input via the user interface.

In various implementations, user interface component 114 may beconfigured to generate a user interface that provides a user withinformation related to system 100 and enables a user to provide input.For example, the user interface may comprise selectable icons, inputfields, and/or other user input options enabling a user to control oneor more aspects of system 100. In some implementations, user interfacecomponent 114 may be configured to generate a user interface thatenables a user to request virtual content to be rendered in theaugmented reality environment. In some implementations, user interfacecomponent 114 may be configured to generate a user interface thatenables a user to modify virtual content information for virtual contentbased on one or more types of user input. For example, a user interfacegenerated by user interface component 114 may be configured to receiverequests to modify virtual content displayed via display device 140.Requests to modify virtual content may comprise requests to modify(i.e., alter) virtual content currently displayed via display device 140and/or requests to swap out the virtual content rendered in an augmentedreality environment for other virtual content. In some implementations,user interface component 114 may be configured to generate and provideto a user an interface that may receive requests to render virtualcontent and/or modify virtual content while virtual content issimultaneously rendered in the augmented reality environment via displaydevice 140. In some implementations, user interface component 114 may beconfigured to generate a user interface that enables a user to requestthe removal of virtual content rendered in the augmented realityenvironment.

In various implementations, user interface component 114 may beconfigured to generate a user interface that provides an indication ofthe virtual content available to be presented via display device 140.Virtual content may comprise one or more virtual content items able todepicted in an augmented reality environment based on one or morereference frames. An augmented reality environment may comprise a spacethat represents a virtual environment that may be superimposed over aperspective of a physical real-world environment around a user. Anaugmented reality environment may include attributes of a virtualenvironment, including virtual content superimposed over portions of thephysical environment. In some implementations, an augmented realityenvironment may represent physical objects in the physical world asvirtual content in the augmented environment.

Virtual content may refer to one or more virtual content items. Avirtual content item may comprise a two- or three-dimensional virtualimage of an object, a part of an object, a surface, a texture, aneffect, and/or other content visibly manifested in views of theaugmented reality environment. For example, a virtual content item maycomprise an effect (or animation) that is rendered in an augmentedreality environment when a particular action of a living entity isidentified (e.g., virtual spinning wheels to replace legs when it isdetermined that the living entity is running). In some implementations,virtual content may comprise an avatar and/or other full- orpartial-body virtual content object depicted based on the living entity.Virtual content comprising an avatar and/or other full- or partial-bodyvirtual content object may be based on an individualized texture map (or“skin”) and created using a three-dimensional full body scan and/orusing other techniques now known or future developed for generatingthree-dimensional content.

In some implementations, virtual content depicted in the augmentedreality environment may comprise a set of virtual content. A set ofvirtual content is one or more virtual content items that share areference frame. That is, the position, orientation, scale, and/or otherparameters of the virtual content item or items in the set of virtualcontent can be manipulated in a coordinated way by manipulating thereference frame for the set of virtual content.

The virtual content available to be presented via display device 140 mayinclude virtual content stored on or accessible via one or more devicesof a user, electronic storage 130, and/or other components of system100. In some implementations, user interface component 114 may beconfigured to provide a list of virtual content available to bepresented via display device 140 obtained from content managementcomponent 116. For example, user interface component 114 may beconfigured to cause a selectable list of virtual content available to bepresented via display device 140 to be provided to a user. The list ofvirtual content available to be presented via display device 140 mayinclude virtual content stored on or accessible via one or more devicesof a user, electronic storage 130, other components of system 100,virtual content available via one or more connected devices (e.g., adevice of a living entity visible within a field of view of the user),and/or virtual content available via a network (e.g., obtainable via theInternet, stored in cloud storage, or otherwise available via anetwork). In some implementations, the list of virtual content mayinclude an indication of a state or action of a living entity that mustbe identified to trigger the rendering of virtual content associatedwith the state or action. The state or action of the living entity maybe identified by content triggering component 118 based on thearrangement of linkage points defined with respect to the living entity.

In some implementations, user interface component 114 may be configuredto cause a selectable list of virtual content objects to be provided toa user via a user interface. In some implementations, user interfacecomponent 114 may be configured to receive a selection indicatingvirtual content to be presented via display device 140. For example,user interface component 114 may be configured to receive user inputindicating a selection of one or more virtual content objects to bepresented via display device 140. In some implementations, contentmanagement component 114 may be configured to store indications ofparticular virtual content triggered or selected to be displayed,particular virtual content triggered or selected to be displayed forspecific types of living entities or specific identified livingentities, particular virtual content triggered or selected to bedisplayed in association with a given action, particular virtual contenttriggered or selected to be displayed in association with a given state,particular virtual content triggered or selected to be displayed at adetermined location, and/or other information indicating virtual contentdisplayed via display device 140. In some implementations, theindications of particular virtual content triggered or selected to bedisplayed may be utilized in conjunction with machine learningtechniques to determine virtual content to depict for a given user, fora given living entity, for a given action or state, and/or at a givenlocation.

In some implementations, a living entity visible within a field of viewof a user may be provided with a user interface that includes aselectable list of virtual content to be displayed in association withthe living entity. For example, the living entity may be provided with alist of virtual content via a device of the living entity (e.g., via asmartphone or wearable device of the living entity). As such, a livingentity may choose the virtual content to be displayed in associationwith or superimposed over their image in the augmented realityenvironment displayed to the user via display device 140.

In some implementations, user interface component 114 may be configuredto generate a user interface that provides one or more selectablecontrols associated with recording, broadcasting, live streaming, and/orotherwise providing an image of an augmented reality environment to oneor more other users. For example, the one or more selectable controlsmay enable a user to pause, stop, fast forward, rewind, and/or otherwisecontrol a recording. In some implementations, the one or more selectablecontrols may enable a user to identify one or more recipients of animage of an augmented reality environment and/or establish one or moreaccess controls associated with the image of the augmented realityenvironment.

Content management component 116 may be configured to manage virtualcontent to be rendered in an augmented reality environment. In variousimplementations, content management component 116 may be configured toobtain, download, upload, modify, remove, and/or otherwise manageinformation stored and/or accessible by system 100. Information storedand/or accessible by system 100 may include virtual content information.Virtual content information may define virtual content (or a set ofvirtual content), a reference frame of the virtual content, acorrelation between the reference frame of the virtual content and oneor more linkage points defined with respect to a living entity (i.e.,the arrangement of the multiple linkage points), and/or otherinformation related to the virtual content.

For example, and referring to FIG. 2, exemplary correlation 200 betweenan arrangement of linkage points defined with respect to a living entityand a reference frame of a virtual content item, in accordance with oneor more implementations. Exemplary correlation 200 may define howvirtual content 204 may be rendered and appear superimposed over or inconjunction with a view of living entity 202 in the augmented realityenvironment. Particular linkage points on living entity 202 may bematched with particular predefined points on virtual content 204. Agiven linkage point of living entity 202 may be matched with a givenpoint of virtual content 204 based on the arrangement of the linkagepoints of living entity 202 and/or based on a pre-defined correlationbetween linkage points defined with respect to particular features ofliving entity 202 (i.e., the head, abdomen, knees, feet, etc.) andpoints of virtual content 204 associated with corresponding features ofa living entity. Living entity 202 is depicted wearing glasses inexemplary correlation 200. The glasses worn by living entity 202 may ormay not be involved in the rendering of virtual content in an augmentedreality environment by system 100, as described further below withrespect to FIG. 3A and FIG. 3B.

In some implementations, the correlation between the reference frame ofvirtual content and the arrangement of linkage points defined withrespect to a living entity may be modified. In some implementations, auser may modify the correlation between the reference frame of virtualcontent and the arrangement of linkage points defined with respect to aliving entity. For example, a user may modify the correlation betweenthe reference frame of virtual content and the arrangement of linkagepoints defined with respect to a living entity via a user interfacegenerated by interface component 114 and presented via display device140. For example, a user may modify the correlation between thereference frame of virtual content and the arrangement of linkage pointsdefined with respect to a living entity as the virtual content isrendered in an augmented reality environment and displayed via displaydevice 140. In some implementations, a user may modify the correlationbetween the reference frame of virtual content and the arrangement oflinkage points defined with respect to a living entity in real-time. Insome implementations, a user may store an image of virtual contentrendered in an augmented reality environment in order to later modifythe correlation between the reference of the virtual content and thearrangement of linkage points.

In some implementations, the correlation between the reference frame ofvirtual content and the arrangement of linkage points defined withrespect to a living entity may be updated over time. For example, one ormore machine learning techniques may be used to update the correlationbetween the reference frame of virtual content and the arrangement oflinkage points defined with respect to a living entity may be updatedover time. The machine learning techniques may be supervised orunsupervised. In some implementations, indications of particulararrangements of linkage points associated with one or more livingentities may be obtained and stored over time. For example, indicationsof particular arrangements of linkage points associated with multipleliving entities may be aggregated by imaging sensors (e.g., imaginingsensor 150) of multiple users over time and stored, indications ofparticular arrangements of linkage points associated with a singleliving entity may be aggregated by imaging sensors (e.g., imaginingsensor 150) of multiple users over time and stored, and/or indicationsof particular arrangements of linkage points associated with a one ormore living entities may be obtained by the user via imagining sensor150 and stored. As such, a network of users may build a database ofindications of particular arrangements of linkage points for all orportion of all living entities encountered; the network of users maybuild a database of indications of particular arrangements of linkagepoints for each, or at least one specific, living entity; a single usermay build a database of indications of particular arrangements oflinkage points for all or portion of all living entities encountered;and/or a single user may build a database of indications of particulararrangements of linkage points for each, or at least one specific,living entity. A database of indications of particular arrangements oflinkage points may be used to update correlations between a referenceframe of virtual content and an arrangement of linkage points definedwith respect to a living entity. For example, one or more machinelearning techniques now known or future developed may be used to updatecorrelations between a reference frame of virtual content and anarrangement of linkage points defined with respect to a living entitybased on one or more databases of indications of particular arrangementsof linkage points. In some implementations, the correlations between thereference frames of virtual content and an arrangement of linkage pointsdefined with respect to a living entity may be updated to moreaccurately render muscle deformation, the effects of gravity, themovement or position of the body of a living entity or aspects of thebody of a living entity while in different states or performingdifferent actions, and/or other characteristics relevant to depictinglife-like virtual content.

In various implementations, virtual content information may comprisemultiple parameters that define virtual content to be displayed in anaugmented reality environment. For example, the parameters may define aposition of the virtual content when displayed in an augmented realityenvironment (e.g., a physical location in the real-world associated withthe virtual content, a position in relation to one or more linkagepoints, and/or a position in relation to one or more other virtualcontent items), a size of the virtual content, an orientation of thevirtual content with respect to a reference frame of the virtualcontent, one or more colors of the virtual content, a shape of thevirtual content, one or more haptic features of the virtual content, oneor more sounds associated with the virtual content, and/or one or moreother parameters that may define how a virtual content object isrendered in an augmented reality environment. For example, parametersdefining one or more animations associated with virtual content maydefine the nature and timing of an animation associated with the virtualcontent object.

In various implementations, virtual content information may comprisetriggering information for virtual content (e.g., a virtual content itemor a set of virtual content). For example, the virtual contentinformation may comprise triggering information for virtual content thatindicates an arrangement of linkage points defined with respect to aliving entity, a state of a living entity, and/or an action of a livingentity that prompt the virtual content to be rendered in the augmentedreality environment when the arrangement of linkage points, state of theliving entity, and/or action of the living entity is detected and/oridentified by content triggering component 118. In other words, thetriggering information may define a correlation between the virtualcontent and one or more arrangements of linkage points defined withrespect to a living entity, a correlation between the virtual contentand a state or action of a living entity, and/or other triggeringinformation related to the virtual content.

In various implementations, content management component 116 may beconfigured to obtain virtual content information. For example, contentmanagement component 116 may be configured to obtain virtual contentinformation from electronic storage. In some implementations, contentmanagement component 116 may be configured to obtain virtual contentinformation stored at one or more devices of user. In someimplementations, content management component 116 may be configured toobtain virtual content information from one or more connected devices(e.g., a device of a living entity visible within a field of view of theuser). For example, content management component 116 may be configuredto receive virtual content information from one or more connecteddevices (e.g., a device of a living entity visible within a field ofview of the user). In some implementations, content management component116 may be configured to receive virtual content information from one ormore connected devices (e.g., a device of a living entity visible withina field of view of the user) responsive to a request for the virtualcontent information from the user (i.e., one or more devices of theuser). In some implementations, content management component 116 may beconfigured to obtain virtual content information via a network (e.g.,via the Internet, cloud storage, and/or one or more other networks). Forexample, content management component 116 may be configured to downloadvirtual content information from the Internet or from cloud storage inresponse to a selection or triggering of virtual content to be displayedon display device 140.

In various implementations, content management component 116 may beconfigured to receive an indication of an arrangement of linkage pointsfrom content triggering component 118 and obtain virtual contentinformation based on the arrangement. For example, content managementcomponent 116 may be configured to receive an indication of a particulararrangement of linkage points from content triggering component 118 andobtain virtual content information based on the particular arrangementand the triggering information of the virtual content information. Thevirtual content information obtained may define the virtual content itemto be displayed when the arrangement is present and a correlationbetween the arrangement and a reference frame of the virtual contentitem.

In various implementations, content management component 116 may beconfigured to receive an indication of a state or action of a livingentity from content triggering component 118 and obtain virtual contentinformation based on the state or action. For example, contentmanagement component 116 may be configured to receive an indication of aparticular state or action identified by content triggering component118 and obtain virtual content information based on the particular stateor action and the triggering information of the virtual contentinformation. The virtual content information obtained may define avirtual content item to be displayed when the state or action isidentified and a correlation between a reference frame of the virtualcontent item and linkage points defined with respect to the livingentity.

In an exemplary implementation, the virtual content item to be displayedwhen the action is identified may comprise an animation associated withthe action. For example, a stored animation depicting an Olympicsprinter running may be associated with the action “running.” When it isdetected that a living entity is running, system 100 may be configuredto cause the stored animation to superimposed over the living entity toappear as if the user is running with the form of an Olympic sprinter.In some implementations, system 100 may use machine learning todetermine virtual content to depict for a given user, for a given livingentity, for a given action or state, and/or at a given location. Forexample, stored indications of particular virtual content triggered orselected to be displayed by a user, particular virtual content triggeredor selected to be displayed for specific types of living entities orspecific identified living entities, particular virtual contenttriggered or selected to be displayed in association with a givenaction, particular virtual content triggered or selected to be displayedin association with a given state, particular virtual content triggeredor selected to be displayed at a determined location, and/or otherinformation indicating virtual content displayed via display device 140may be monitored and accessed over time to determine virtual content todepict for a given user, for a given living entity, for a given actionor state, and/or at a given location.

In some implementations, content management component 116 may beconfigured to obtain virtual content information from a sign post. Forexample, in some implementations, a sign post may comprise a wirelesslyconnectable device linked to a power source and electronic storage. Insome implementations, a device of the living entity (e.g., a smartphone,a tablet, a computer, a wearable device, and/or other user deviceassociated with the living entity) may be a sign post configured toprovide virtual content information to a device of the user. Forexample, a visor or glasses of a human living entity may serve as a signpost, and a collar or other wearable item of an animal/pet living entitymay comprise a sign post. In some implementations, content managementcomponent 116 may be configured to obtain virtual content informationfrom a transponder of a living entity within the field of view of a userand/or within a proximity of the user. In some implementations, contentmanagement component 116 may be configured obtain virtual contentinformation from a sign post as described in co-pending U.S. patentapplication Ser. No. 15/707,854, entitled “SYSTEMS AND METHODS FORUTILIZING A DEVICE AS A MARKER FOR AUGMENTED REALITY CONTENT,”, thedisclosure of which is hereby incorporated by reference in its entiretyherein.

In some implementations, content management component 116 may beconfigured to determine whether virtual content information definingvirtual content is locally stored or available via a device of a user,electronic storage 130, display device 140, and/or other components ofsystem 100. Based on a determination that the virtual contentinformation is not available via a device of a user, electronic storage130, display device 140, or other component of system 100, contentmanagement component 116 may be configured to download virtual contentinformation from the Internet or from cloud storage. For example,content management component 116 may be configured to automaticallydownload virtual content information based on a determination that thevirtual content information is not available via a device of a user,electronic storage 130, display device 140, or other component of system100. In some implementations, content management component 116 may beconfigured to automatically download or request virtual contentinformation from a transponder of the living entity, a wearable deviceof the living entity (e.g., a visor or glasses in the case of a humanand/or a collar in the case of an animal), a user device (e.g., a smartphone), and/or other device of the living entity based on adetermination that the virtual content information is not available viaa device of a user, electronic storage 130, display device 140, or othercomponent of system 100. In some implementations, content managementcomponent 116 may be configured to automatically download virtualcontent information from the Internet or from cloud storage responsiveonly to a determination that the virtual content information is notavailable via a device of a user, electronic storage 130, display device140, one or more other component of system 100, a transponder of theliving entity, a wearable device of the living entity (e.g., a visor orglasses in the case of a human and/or a collar in the case of ananimal), a user device (e.g., a smart phone), and/or other device of theliving entity.

In various implementations, content management component 116 may beconfigured to store virtual content information. For example, contentmanagement component 116 may be configured to store virtual contentinformation at one or more devices of a user, electronic storage 130,display device 140, and/or other storage component accessible by system100. For example, content management component 116 may be configured tostore virtual content information in cloud storage.

In some implementations, content management component 116 may beconfigured to generate virtual content information. Virtual contentinformation defining virtual content may be generated using varioustechniques. Virtual content information may be initially generated usingone or more techniques for generating three-dimensional content. Invarious implementations, virtual content information defining virtualcontent objects may be generated based on user input identifying one ormore parameters. Therefore, the virtual content information may includeinformation indicating the one or more parameters in order to define avirtual content object. In some implementations, virtual contentinformation defining virtual content objects may be generated usingthree-dimensional animation techniques, using three-dimensional drawings(e.g., using computer-aided design (CAD) software), based onthree-dimensional photography of real-world objects, based on stillimages and/or videos captured with a three-dimensional camera, usingthree-dimensional graphic modeling techniques, and/or using othertechniques now known or future developed for generatingthree-dimensional content. The virtual content information may begenerated automatically and/or based on user input related to the one ormore techniques for generating three-dimensional content. In variousimplementations, virtual content information may be generated, modified,and/or otherwise produced in real-time based on user input.

Content triggering component 118 may be configured to trigger images ofvirtual content to be rendered in an augmented reality environment. Invarious implementations, content triggering component 118 may beconfigured to detect a living entity and multiple linkage points for theliving entity visible within the field of view of a user. Based on thearrangement of the linkage points, content triggering component 118 maybe configured to cause content management component 116 to obtainvirtual content information defining particular virtual content that isto be displayed when the arrangement is present and cause imagegeneration component 120 to generate an image of the particular virtualcontent to be displayed in the augmented reality environment. Triggeringinformation may be used to cause an image of virtual content to berendered in an augmented reality environment based on the detection of aliving entity and multiple linkage points defined with respect to theliving entity within the field of view of a user, the determination of aparticular arrangement of the multiple linkage points, and/or theidentification of a state or action of the living entity based on thearrangement of the multiple linkage points.

In various implementations, content triggering component 118 may beconfigured to detect a living entity and one or more linkage points forthe living entity visible within the field of view of a user using oneor more image recognition techniques, object recognition techniques,and/or body recognition techniques. In some implementations, contenttriggering component 118 may be configured to detect a living entity andone or more linkage points for the living entity visible within thefield of view of a user based on a device of the living entity (e.g., asmartphone, a tablet, a computer, a wearable device, and/or other userdevice associated with the living entity). For example, contenttriggering component 118 may be configured to detect a living entity andone or more linkage points for the living entity visible within thefield of view of a user based on a transponder of the living entity.

In various implementations, content triggering component 118 may beconfigured to detect a living entity and one or more linkage points forthe living entity visible within the field of view of a user inreal-time. In some implementations, content triggering component 118 maybe configured to detect multiple living entities and multiple linkagepoints for each of the living entities visible within the field of viewof a user simultaneously.

In various implementations, content triggering component 118 may beconfigured to detect a living entity and one or more linkage points forthe living entity visible within the field of view of a user based on aseries of images. The series of images may be obtained from imagingsensor 150. Imaging sensor 150 may be configured to generate outputsignals conveying a series of images depicting a field of view of theuser. Content triggering component 118 may be configured to utilize oneor more image recognition techniques to detect a living entity and oneor more linkage points for the living entity visible within the field ofview of the user based on a series of images.

In some implementations, content triggering component 118 may beconfigured to detect a living entity visible within the field of view ofthe user by comparing images within the series of images. For example,content triggering component 118 may be configured to detect a livingentity visible within the field of view of the user by comparing a firstimage of the series of images captured at a first point in time and asecond image of the series of images captured at a second point in time.In some implementations, content triggering component 118 may beconfigured to use one or more image recognition techniques, objectrecognition techniques, and/or body recognition techniques to detect aliving entity visible within a field of view of a user when comparing afirst image of the series of images captured at a first point in timeand a second image of the series of images captured at a second point intime. Based on the comparison of the first image and the second image,content triggering component 118 may be configured to detect a livingentity visible within the field of view of the user.

In some implementations, content triggering component 118 may beconfigured to utilize one or more other image recognition techniques todetect a living entity visible within the field of view of the user. Insome implementations, content triggering component 118 may be configuredto detect a living entity using facial recognition or body recognition.In some implementations, content triggering component 118 may beconfigured to detect a living entity based on the establishment ofwireless communication between a user device, display device 140, and/orother component of system 100 with a device of the living entity (e.g.,a smartphone, a tablet, a computer, a wearable device, and/or other userdevice associated with the living entity). For example, contenttriggering component 118 may be configured to detect a living entitybased on the establishment of wireless communication between a userdevice, display device 140, and/or other component of system 100 with adevice of the living entity on which an application associated withsystem 100 is downloaded. In some implementations, content triggeringcomponent 118 may be configured to detect a living entity based on adetermination that a device of the living entity is within a geographicproximity of a user device, display device 140, and/or other componentof system 100.

In some implementations, content triggering component 118 may beconfigured to detect a living entity within a proximity of the userbased on audio information received by a user device, display device140, and/or other component of system 100. For example, audioinformation received may indicate the presence of a living entity withina proximity of the user, location information for the living entity,and/or other information of the living entity. The audio information maycomprise a sound that is associated with the living entity. For example,the audio information may be detected based on an audio signal receivedvia system 100. Audio information may be obtained from the receivedaudio signal. In some implementations, the audio information may beassociated with a predefined living entity (i.e., a specific user and/orspecific pet), a predefined type of living entity (e.g., a specificspecies, a specific subset of a species, and/or other type of livingentity), a predefined group of living entities (e.g., family, friends,co-workers, and/or other group of living entities associated with theuser).

In some implementations, content triggering component 118 may beconfigured to detect a living entity visible within the field of view ofa user and/or within a proximity of the user based on a transponder ofthe living entity. For example, content triggering component 118 may beconfigured to detect a living entity by recognizing a transponderassociated with one or more living entities. For example, a device ofthe living entity may comprise a transponder. In some implementations, atransponder may be located on or within one or more items worn and/oraffixed to the living entity. For example, a transponder may be locatedon or within clothing, jewelry, a wearable pet item, and/or other itemworn and/or affixed to the living entity. A transponder may comprise adevice configured to emit a signal that contains virtual contentinformation, triggering information, and/or other information used bysystem 100 to present virtual content in an augmented realityenvironment. For example, a transponder of a living entity may beconfigured to emit a signal that contains identification information fora living entity, virtual content information defining virtual content tobe displayed based on the living entity (e.g., virtual contentinformation defining virtual content unique to the living entity),location information for the living entity, linkage point informationfor one or more linkage points located on and/or generated by thetransponder, and/or triggering information for virtual content to bedisplayed based on the living entity. In some implementations, atransponder of a living entity may only emit a signal containinginformation used by system 100 to present virtual content in anaugmented reality environment in response to receipt of a signal emittedby system 100. For example, a user device, display device 140, and/orother component of system 100 may emit a signal that prompts atransponder of a living entity to provide information that facilitatesthe detection of a living entity visible within the field of view of theuser and/or within a proximity of the user.

In some implementations, content triggering component 118 may beconfigured to receive a signal from a transponder of a living entity.The signal may indicate an identification of a living entity, or includeidentification information for a living entity, visible within a fieldof view of a user and/or with a proximity of the user. Based on theidentification of the living entity or identification information forthe living entity, content triggering component 118 may be configured toobtain virtual content information from content management component116. For example, content management component 116 may search forvirtual content associated with the identification information (oridentified living entity) stored on or accessible via one or moredevices of a user, electronic storage 130, other components of system100, virtual content available via one or more connected devices (e.g.,a device of a living entity visible within a field of view of the user),and/or virtual content available via a network (e.g., obtainable via theInternet, stored in cloud storage, or otherwise available via anetwork). Based on the received signal, content triggering component 118may be configured to trigger virtual content to be rendered based onvirtual content information obtained based on the identificationinformation (or identified living entity).

In various implementations, content triggering component 118 may beconfigured to trigger images of virtual content to be rendered in anaugmented reality environment based on information received from aliving entity. For example. content triggering component 118 may beconfigured to receive triggering information from a transponder of theliving entity, a wearable device of the living entity (e.g., a visor orglasses in the case of a human and/or a collar in the case of ananimal), a user device (e.g., a smart phone), and/or other device of theliving entity. The triggering information received from the livingentity may cause an image of virtual content to be rendered in anaugmented reality environment based on living entity and multiplelinkage points defined with respect to the living entity within thefield of view of a user. In some implementations, triggering informationreceived from a living entity may cause an image of virtual content tobe rendered in an augmented reality environment based on thedetermination of a particular arrangement of the multiple linkage pointsdefined with respect to the living entity and/or the identification of astate or action of the living entity based on the arrangement of themultiple linkage points. In some implementations, content triggeringcomponent 118 may be configured to trigger virtual content unique to aliving entity visible within a field of view of the user to be renderedin an augmented reality environment based on triggering informationreceived from the living entity. For example, the triggering informationmay be provided with virtual content information defining virtualcontent to be displayed based on the living entity (e.g., virtualcontent information defining virtual content unique to the livingentity) and/or prompt content management component 116 to obtain virtualcontent information defining virtual content to be displayed based onthe living entity (e.g., virtual content information defining virtualcontent unique to the living entity).

In various implementations, content triggering component 118 may beconfigured to detect linkage points for the living entity visible withinthe field of view of a user. The linkage points may comprise indicators,transponders, stitching points, and/or other identified points. Thelinkage points associated with a living entity may serve as an anchorfor the reference frame of virtual content. As such, the position of thelinkage points in the real world may define the reference frame ofvirtual content with respect to the real world. For example, a set ofmultiple linkage points may serve as an anchor for the reference frameof virtual content by orienting the virtual content based on acorrelation between the reference frame of the virtual content and thearrangement of the set of linkage points. In various implementations,the space between each of the set of linkage points and/or thearrangement of the set of linkage points may provide information as toorientation, size, and direction of virtual content.

In various implementations, the linkage points may be defined withrespect to the living entity. In some implementations, one or morelinkage points may be located on and/or generated by one or more devicesof the living entity. For example, a linkage point may be located onand/or generated by a transponder of the living entity, a wearabledevice of the living entity (e.g., a visor or glasses in the case of ahuman and/or a collar in the case of an animal), a user device (e.g., asmart phone), and/or other device of the living entity. In someimplementations, one or more linkage points may be located on and/orgenerated by a transponder of a living entity. For example, atransponder or other device of a user (e.g., a visor, glasses, or otherwearable device) may serve as at least one linkage point of a livingentity. That is, the at least one linkage point for a wearable device(e.g., an AR headset) worn by a human may serve as at least one linkagepoint, and a dog collar with a transponder worn by a dog may serve as atleast one linkage point. A transponder or other device of a user servingas a linkage point may be predefined as a specific linkage point. Insome implementations, linkage point information received via a signaltransmitted by the transponder may indicate a position of the linkagepoint established by the transponder with respect to the living entity.In other words, a transponder or other device of a user serving as alinkage point may be predefined as a specific linkage point correlatedto a specific portion of virtual content. That is, the specific linkagepoint may be associated with a predefined position on the body of theliving entity. For example, the at least one linkage point for awearable device (e.g., an AR headset) worn by a human may serve as alinkage point on the head of the living entity, and a dog collar with atransponder worn by a dog may serve as a linkage point on the neck of adog. As such, content triggering component 118 may be configured todetect the at least one linkage point defined based on a transponder orother device of a user (e.g., a visor, glasses, or other wearabledevice) and identify the at least one linkage point as a specificlinkage point. Based on the at least one linkage point defined withrespect to a transponder or other device of a user, content triggeringcomponent 118 may be configured to detect and identify one or more otherlinkage points using one or more image recognition techniques, objectrecognition techniques, and/or body recognition techniques. The at leastone linkage point defined with respect to a transponder or other deviceof a user and the one or more other linkage points detected andidentified using one or more image recognition techniques, objectrecognition techniques, and/or body recognition techniques may comprisea set of linkage points, and content triggering component 118 may beconfigured to determine an arrangement of the set of linkage points.

In some implementations, the linkage points may be located on one ormore articles of clothing worn by the living entity. For example, thelinkage points may be located on and/or comprise high visibilityclothing (e.g., ANSI Class II or ANSI Class III jacket, vest, or otherclothing) and/or clothing including reflective material affixed to thefront and/or back of the living entity (e.g., reflective stripspositioned in a distinctive pattern, reflective material depicting aspecific logo or symbol, and/or other reflective material). In someimplementations, the linkage points may be located on and/or compriseone or more items worn and/or affixed to the living entity. For example,the linkage points may be located on and/or comprise reflective tapestrips affixed to the living entity, marker medallions or other jewelry,and/or other items configured to be used to provide linkage pointsassociated with the living entity. The marker medallions or otherjewelry may include a pattern formed by an LED grid. In an exemplaryimplementation in which a living entity visible within the field of viewof a user comprises an animal, the linkage points may be located onand/or generated by a collar, a wearable pet item, and/or one or moreother animal accessories worn by or affixed to the animal. In someimplementations, an IR camera may be used to identify linkage pointslocated and/or comprising medallions or other jewelry that includes apattern formed by an LED grid. Display device 140 and/or imaging sensor150 may comprise or be physically located in an IR camera capable ofidentifying linkage points located and/or comprising medallions or otherjewelry that includes a pattern formed by an LED grid.

In some implementations, the linkage points may be defined by one ormore body parts of the living entity. For example, one or moresignificant body parts may serve as linkage points for content.Significant body parts may include the living entity's head or face, endpoints of the living entity's body (e.g., top of head, end of fingers,bottom of feet, end of torso, and/or other end points of the livingentity's body), and/or one or more other significant body parts. In someimplementations, content triggering component 118 may be configured todetect linkage points defined by one or more body parts of the livingentity using one or more image recognition techniques, objectrecognition techniques, and/or body recognition techniques.

In some implementations, the linkage points may be defined by astandardized linkage point. For example, a standardized linkage pointmay comprise a specific geometric shape, such as a “+” which wouldprovide information associated with the linkage point. In variousimplementations, multiple linkage points, each defined by a standardizedlinkage points, may serve as an anchor for the reference frame ofvirtual content (i.e., orient the virtual content based on a correlationbetween the reference frame of the virtual content and the arrangementof the multiple linkage points). For example, in some implementations,at least 2 or 3 linkage points may collectively serve as an anchor forthe reference frame of virtual content. Information associated with thelinkage point may comprise an indication of a correlation between thelinkage point and a reference frame of virtual content to be displayedin the augmented reality environment based on at least that linkagepoint.

In some implementations, the linkage points may be defined by one ormore specific colors. For example, the linkage points may be defined bypredefined colors associated with one or more specific linkage points tobe synchronized with one or more points of virtual content. The specificcolors may be colors outside the visible spectrum for human beings. Insome implementations, the linkage points may be defined by one or morespecific sound patterns. For example, the linkage points may be definedby predefined sound patterns associated with one or more specificlinkage points to be synchronized with one or more points of virtualcontent. The specific sound patterns may be sounds of a unique pitch orpattern (e.g., sounds inaudible to humans). In some implementations,content triggering component 118 may be configured to detect linkagepoints defined by one or more specific colors or sound patterns usingdisplay device 140, imaging sensor 150, and/or one or more other sensorsof display device 140.

In some implementations, linkage points may be defined by LED orinfrared-based images or patterns. In some implementations, an IR cameraand/or IR sensor may be used to identify linkage points defined by LEDor infrared-based images or patterns. Display device 140 and/or imagingsensor 150 may comprise or be physically located in an IR camera capableof identifying linkage points defined by LED or infrared-based images orpatterns.

In various implementations, content triggering component 118 may beconfigured to detect linkage points for the living entity visible withinthe field of view of a user based on a series of images. The series ofimages may be obtained from imaging sensor 150. In some implementations,content triggering component 118 may be configured to detect linkagepoints for the living entity visible within the field of view usingfacial and/or body recognition techniques, by identifying one or morebody parts of the living entity, by detecting clothing or items worn byliving entity configured to serve as linkage points for virtual content,by detecting one or more specific colors or sound patterns, and/or usingone or more other image recognition techniques capable of detectinglinkage points for the living entity visible within the field of view ofa user.

In various implementations, content triggering component 118 may beconfigured to determine an arrangement of the linkage points detectedfor a given living entity. The arrangement of linkage points may definethe position of the linkage points in relation to one another. In otherwords, the arrangement of the linkage points may define the relativeposition of the linkage points to each other. In some implementations,content triggering component 118 may be configured to determine anarrangement of the linkage points detected for a given living entitybased on a series of images. The series of images may be obtained fromimaging sensor 150. For example, content triggering component 118 may beconfigured to determine a first arrangement of the linkage points basedon a first image of the series of images captured at a first point intime and a second arrangement of the linkage points based on a secondimage of the series of images captured at a second point in time. Insome implementations, content triggering component 118 may be configuredto determine an arrangement of the linkage points detected for each ofmultiple living entities simultaneously.

In various implementations, content triggering component 118 may beconfigured to trigger images of virtual content to be rendered in anaugmented reality environment based on the arrangement of the linkagepoints defined with respect to the living entity. Based on thearrangement of the linkage points, content triggering component 118 maybe configured to cause content management component 116 to obtainvirtual content information defining particular virtual content that isto be displayed when the arrangement is present and cause imagegeneration component 120 to generate an image of the particular virtualcontent to be displayed in the augmented reality environment. Forexample, content triggering component 118 may be configured to providean indication to content management component 116 of a particulararrangement determined for a living entity and cause content management116 to obtain virtual content information based on the indication of theparticular arrangement and the triggering information of the virtualcontent information. The virtual content information obtained may definethe virtual content item to be displayed when the arrangement is presentand a correlation between the arrangement and a reference frame of thevirtual content item. Based on the virtual content information obtained,content triggering component 118 may be configured to provideinstructions to image generation component 120 to generate an image ofthe virtual content to be displayed in an augmented reality environmentbased on the virtual content information obtained via content managementcomponent 116. In some implementations, content triggering component 118may be configured to trigger images of virtual content to be rendered inan augmented reality environment based on multiple living entitiessimultaneously.

For example, and referring to FIG. 3A, exemplary display 300 of anaugmented reality environment is illustrated, in accordance with one ormore implementations. Exemplary display 300 may include a view of aliving entity. For example, exemplary display 300 may illustrate a viewof a living entity via display device 140. In various implementations,content triggering component 118 may be configured to detect the livingentity and multiple linkage points for the living entity visible withinthe field of view of a user. For example, exemplary display 300 maycomprise one of a series of images depicting a field of view of theuser, and content triggering component 118 may be configured to detectthe living entity and multiple linkage points for the living entityvisible within the field of view of a user based on the series ofimages. Content triggering component 118 may be configured to determinean arrangement of the linkage points detected for the living entityvisible within the field of view of a user depicted by exemplary display300. Based on the arrangement of the linkage points, content triggeringcomponent 118 may be configured to provide instructions to imagegeneration component 120 to generate an image of virtual content to bedisplayed in the augmented reality environment, as discussed below withrespect to FIG. 3B.

Exemplary display 300 includes a view of a living entity wearingglasses. The glasses worn by the living entity in exemplary display 300may or may not be involved in the rendering of virtual content in theaugmented reality environment by system 100. In various implementations,the glasses worn by the living entity may be unrelated to the renderingof virtual content by system 100. However, in some implementations, theglasses worn by the living entity may include a transponder and/orcomprise a wearable device of the living entity. In someimplementations, the glasses worn by the living entity may generateand/or serve as one or more linkage points of the living entity, providevirtual content information, provide triggering information, and/orotherwise interact with system 100 to facilitate the rendering of thevirtual content as depicted in the exemplary display 302 of theaugmented reality environment.

In various implementations, content triggering component 118 may beconfigured to identify a state of the living entity or an action of theliving entity based on the arrangement of the linkage points at one ormore points in time. A state of a living entity may refer to thephysical state of the living entity at a given point in time. Forexample, the state of a living entity may be standing, sitting, layingdown, and/or one or more other current physical states of the livingentity. An action of a living entity may refer to a physical action ofthe living entity at a given time. For example, the action of a livingentity may be running, standing up, sitting down, walking, jumping, actsof intimacy, and/or one or more other actions of the living entity. Invarious implementations, content triggering component 118 may beconfigured to identify an action of the living entity based on thearrangement over a period of time. For example, content triggeringcomponent 118 may be configured to identify an action of the livingentity based on a first arrangement of the linkage points at a firstpoint in time and a second arrangement of the linkage points at a secondpoint in time. In some implementations, content triggering component 118may access a database comprising information indicating arrangements oflinkage points and corresponding states or actions. In someimplementations, content triggering component 118 may be configured toidentify a state of the living entity or an action of the living entitybased on the arrangement of the linkage points at a given time andinformation indicating a corresponding state or action to thearrangement. In some implementations, content triggering component 118may be configured to identify a state of multiple living entities or anaction of multiple living entities simultaneously.

In various implementations, content triggering component 118 may triggerimages of virtual content to be rendered in an augmented realityenvironment based on the identified state or action of the livingentity. Based on the state or action of the living entity, contenttriggering component 118 may be configured to cause content managementcomponent 116 to obtain virtual content information defining particularvirtual content that is to be displayed when the state or action of theliving entity is identified and cause image generation component 120 togenerate an image of the particular virtual content to be displayed inthe augmented reality environment. For example, content triggeringcomponent 118 may be configured to provide an indication to contentmanagement component 116 of a particular state or action identified fora living entity and cause content management 116 to obtain virtualcontent information based on the indication of the particular state oraction and the triggering information of the virtual contentinformation. The virtual content information obtained may define thevirtual content item to be displayed when the state or action isidentified. Based on the virtual content information obtained, contenttriggering component 118 may be configured to provide instructions toimage generation component 120 to generate an image of the virtualcontent to be displayed in an augmented reality environment based on thevirtual content information obtained via content management component116.

For example, and referring to FIG. 4A, exemplary display 400 of anaugmented reality environment is illustrated, in accordance with one ormore implementations. Exemplary display 400 may include a view ofmultiple living entities. For example, exemplary display 400 mayillustrate a view of multiple living entities via display device 140. Invarious implementations, content triggering component 118 may beconfigured to detect the presence of the multiple living entities andmultiple linkage points for each of the living entities visible withinthe field of view of a user. For example, exemplary display 400 maycomprise one of a series of images depicting a field of view of theuser, and content triggering component 118 may be configured to detectthe living entities and multiple linkage points for the living entitiesvisible within the field of view of a user based on the series ofimages. Content triggering component 118 may be configured to determinean arrangement of the linkage points detected for the living entitiesvisible within the field of view of a user depicted by exemplary display400. Based on the arrangement of the linkage points, content triggeringcomponent 118 may be configured to identify an action of the livingentities. For example, content triggering component 118 may identify theaction of the living entities in exemplary display 400 to be jumping.Based on the identified action of the living entities in exemplarydisplay 400 (i.e., jumping), content triggering component 118 may beconfigured to provide instructions to image generation component 120 togenerate images of multiple virtual content items or sets of virtualcontent to be displayed in the augmented reality environmentsimultaneously, as discussed below with respect to FIG. 4B.

In various implementations, content triggering component 118 may beconfigured to identify the living entity. The identification of theliving entity may comprise a specific living entity (i.e., a specificuser and/or specific pet), a type of living entity (e.g., a specificspecies, a specific subset of a species, and/or other type of livingentity), a predefined group of living entities (e.g., family, friends,co-workers, and/or other group of living entities associated with theuser), and/or other one or more other identifications of the livingentity. In various implementations, content triggering component 118 maybe configured to identify a living entity using facial recognition orbody recognition, by recognizing a transponder associated with one ormore specific living entities, by recognizing a user device associatedwith one or more specific living entities, based on audio informationassociated with one or more specific living entities, by recognizing oneor more specific items within the field of view of the user associatedwith one or more specific living entities, and/or using one or moreother recognition techniques. For example, an audio signal for a dogwhistle may be processed to obtain audio information that indicates aspecific dog associated with the dog whistle. As such, the specific dog(e.g., a neighborhood dog) may be identified upon receipt of audioinformation associated with the dog whistle. In some implementations,content triggering component 118 may be configured to identify a livingentity based on user selection of a living entity. For example, contenttriggering component 118 may be configured to identify a living entitybased on user selection of a living entity received via a user interfacegenerated by user interface component 114. In some implementations,content triggering component 118 may be configured to identify multipleliving entities simultaneously.

In various implementations, content triggering component 118 may triggerimages of virtual content to be rendered in an augmented realityenvironment based on the identification of the living entity. Eachspecific living entity, type of living entity, and/or group of livingentities may be associated with specific virtual content. That is,virtual content information may define virtual content items to bedisplayed when a specific living entity, type of living entity, and/orgroup of living entities is present. Based on the identification of theliving entity, content triggering component 118 may be configured tocause content management component 116 to obtain virtual contentinformation defining particular virtual content that is to be displayedwhen the identified living entity is identified and cause imagegeneration component 120 to generate an image of the particular virtualcontent to be displayed in the augmented reality environment. Forexample, content triggering component 118 may be configured to providean indication to content management component 116 of the identifiedliving entity and cause content management 116 to obtain virtual contentinformation based on the indication of the identified living entity. Thevirtual content information obtained may define the virtual content itemto be displayed when the identified living entity is present within thefield of view of the user. Based on the virtual content informationobtained, content triggering component 118 may be configured to provideinstructions to image generation component 120 to generate an image ofthe virtual content to be displayed in an augmented reality environmentbased on the virtual content information obtained via content managementcomponent 116. In some implementations, a user may select the virtualcontent information to be obtained by selecting the virtual content theuser's wishes to display and/or modify. In such case, content triggeringcomponent 118 may be configured to provide instructions to imagegeneration component 120 to generate an image of the selected virtualcontent to be displayed in an augmented reality environment based on thevirtual content information obtained via content management component116.

Image generation component 120 may be configured to generate an image ofvirtual content to be displayed in an augmented reality environment. Invarious implementations, image generation component 120 may beconfigured to generate an image of virtual content to be displayed in anaugmented reality environment visible via display device 140. Images ofvirtual content generated by image generation component 120 may bepresented via a display of display device 140 in conjunction with thereal world so that the virtual content appears as if it exists in thereal world. In various implementations, image generation component 120may be configured to generate an image of virtual content to bedisplayed in an augmented reality environment based at least on a user'sfield of view and virtual content information obtained via contentmanagement component 116. In some implementations, image generationcomponent 120 may be configured to generate images of multiple virtualcontent items or sets of virtual content to be displayed in theaugmented reality environment simultaneously. For example, a firstvirtual content item based on a first reference frame may be depictedsimultaneously with a second virtual content item based on a secondreference frame.

In various implementations, image generation component 120 may beconfigured to generate an image of virtual content to be displayed in anaugmented reality environment based on a user's field of view. Whenutilizing display device 140, a display of the display device maycontain a view of the real world based on the user's field of view. Auser's field of view may be defined based on orientation information,location information, and/or other information. For example, a user'sfield of view may be defined based at least on orientation informationassociated with display device 140 and location information associatedwith display device 140. Orientation information may define anorientation of display device 140. In some implementations, theorientation of display device 140 may refer to one or more of a pitchangle, a roll angle, a yaw angle, and/or other measurements. Orientationinformation may be obtained from an orientation sensor of display device140. When looking through display device 140, the orientation of displaydevice 140 may indicate the direction of a user's gaze. In someimplementations, one or more eye tracking techniques now known or futuredeveloped may be used to determine the direction of gaze of a user. Forexample, display device 140 may capture the images of a user within adisplay device and extract a position of the user's eyes. The positionof the user's eyes may be used to determine a more precise indication ofthe direction of the user's gaze. Location information may identify aphysical location of display device 140. In some implementations, thephysical location of display device 140 may refer to the geographiclocation of display device 140. Location information may identify aphysical location based on GPS coordinates, an address, a relativeposition with respect to one or more identified locations, and/or otherinformation. Location information may be obtained from a GPS componentof a user device, display device 140, and/or other component of system100. By determining the direction of a user's gaze and the user'sphysical position in the real world, a user's field of view may bedetermined.

In various implementations, image generation component 120 may beconfigured to generate an image of virtual content to be displayed in anaugmented reality environment based on virtual content informationobtained via content management component 116. In implementations inwhich the virtual content comprises a virtual content item, the image ofthe virtual content item may comprise a three-dimensional virtual imageof the item. Virtual content information may define virtual content (ora set of virtual content), a reference frame of the virtual content,and/or a correlation between linkage points and the reference frame ofthe virtual content. Linkage points may be defined with respect to aliving entity in the real world. The linkage points may serve as ananchor for the reference frame of the virtual content. As such, whenrendered in an augmented reality environment by display device 140, thevirtual content may appear within a user's field of view based on howthe reference frame of the virtual content is correlated to the realworld by virtue of the position of the linkage points (and the livingentity) in the real world.

In various implementations, virtual content information may define acorrelation between one or more linkage points and one or more pointsassociated with virtual content. For example, one or more pointsdefining a virtual content item (and its reference frame) inthree-dimensional space may be correlated to one or more linkage pointsof a living entity. Therefore, a reference frame for virtual content maybe anchored to multiple linkage points simultaneously.

In various implementations, image generation component 120 may beconfigured to generate an image of virtual content to be displayed inthe augmented reality environment based on a correlation between linkagepoints and the reference frame of the virtual content. For example, andreferring to FIG. 3A, exemplary display 300 of an augmented realityenvironment is illustrated, in accordance with one or moreimplementations. In various implementations, content triggeringcomponent 118 may be configured to detect the living entity and multiplelinkage points for the living entity visible within the field of view ofa user. Based on the arrangement of the linkage points, image generationcomponent 120 may be configured to generate an image of virtual contentto be displayed in the augmented reality environment. For example, andreferring to FIG. 3B, exemplary display 302 of an augmented realityenvironment is illustrated, in accordance with one or moreimplementations. Exemplary display 302 may include an image of virtualcontent superimposed over a view of a living entity in the augmentedreality environment. In an exemplary implementation, exemplary display302 may include an image of virtual content generated by imagegeneration component 120 based on a correlation between linkage pointsand the reference frame of the virtual content. For example, thecorrelation between the linkage points and the reference frame of thevirtual content may comprise exemplary correlation 200 depicted in FIG.2. The image of virtual content generated by image generation component120 may be caused to be rendered in the augmented reality environmentvia display control component 122.

In various implementations, image generation component 120 may beconfigured to generate an image of virtual content to be displayed inthe augmented reality environment based on the size of the arrangementof the multiple linkage points within the field of view of the user. Forexample, the size of the arrangement of the multiple linkage pointswithin the field of view of the user may determine the reference frame,or size of the reference frame, for the virtual content to be depictedin the augmented reality environment. In various implementations, imagegeneration component 120 may be configured to generate an image ofvirtual content to be displayed in the augmented reality environmentbased on the distance of the living entity from the user. For example,virtual content superimposed on a living entity further away from a usermay appear smaller than virtual content superimposed on a living entitycloser to the user. In various implementations, image generationcomponent 120 may be configured to automatically generate new images ofvirtual content to be displayed in the augmented reality environment inreal-time as the size of the arrangement of the multiple linkage pointschanges and/or as the distance of the living entity from the userchanges. In some implementations, the size of virtual content may be setto a predefined size and adjusted based on the size of the arrangementof the multiple linkage points. As such, the virtual content may be madeto appear larger for a human and smaller for a pet based on thearrangement of the linkage points for each of the human and the pet.

In various implementations, image generation component 120 may beconfigured to generate an image of virtual content to be displayed inthe augmented reality environment based on an action or state of theliving entity within the field of view of the user. In someimplementations, image generation component 120 may be configured togenerate images of multiple virtual content items or sets of virtualcontent to be displayed in the augmented reality environment based on anaction or state of multiple living entities within the field of view ofthe user. For example, and referring to FIG. 4A, exemplary display 400of an augmented reality environment is illustrated, in accordance withone or more implementations. Exemplary display 400 may include a view ofmultiple living entities. The arrangement of the linkage points detectedfor the living entities visible within the field of view of a userdepicted by exemplary display 400 may be detected by content triggeringcomponent 118. Based on the arrangement of the linkage points, contenttriggering component 118 may identify the action of the living entitiesin exemplary display 400 to be jumping. Based on the identified actionof the living entities in exemplary display 400 (i.e., jumping), imagegeneration component 120 may be configured to generate images ofmultiple virtual content items or sets of virtual content to bedisplayed in the augmented reality environment simultaneously. Forexample, and referring to FIG. 4B, exemplary display 402 of an augmentedreality environment is illustrated, in accordance with one or moreimplementations. Exemplary display 402 may include multiple virtualcontent items displayed in the augmented reality environmentsimultaneously. In an exemplary implementation, exemplary display 402may include an image of multiple virtual content items generated byimage generation component 120 based on the identified action of theliving entities (i.e., jumping) and virtual content informationassociated with virtual content to be displayed when the action of theliving entities is identified. The virtual content information maydefine a correlation between linkage points and the reference frame ofthe virtual content used to generate the image of the image of multiplevirtual content items. The image of virtual content generated by imagegeneration component 120 may be caused to be rendered in the augmentedreality environment via display control component 122.

In various implementations, display control component 122 may causeimage generation component 120 to generate and render an image ofvirtual content in an augmented reality environment based on a non-humanliving entity. For example, FIG. 5A, FIG. 5B, and FIG. 5C illustrateexemplary displays of an augmented reality environment including virtualcontent rendered based on a non-human living entity, in accordance withone or more implementations. Exemplary display 502 depicts a view of anon-human living entity—i.e., a dog. The presence of the dog in thefield of a view of a user may be detected by content triggeringcomponent 118 using one or more of the techniques described herein. Forexample, content triggering component 118 may be configured to detectthe presence of the dog within the field of view of the user based ontransponder 504 of the living entity. In exemplary display 502,transponder 504 may be located on or within a dog collar or otherwearable device of the dog. Exemplary display 506 depicts a view of thesame non-human living entity (i.e., the same dog) wearable item 508 maybe used to detect the presence of the dog within the field of view ofthe user. For example, wearable item 508 may comprise a vest and/orother pet accessory worn by the dog to facilitate the rendering ofvirtual content based on the dog in the augmented reality environment.In some implementations, wearable item 508 may comprise a set of linkagepoints that may serve as an anchor for virtual content in the augmentedreality environment. For example, each of the set of linkage points ofwearable item 508 may be predefined and correlated with virtual contentto be presented based on the dog. In other words, each of the linkagepoints may be predefined to represent points on the dog that may becorrelated with points of the virtual content. In some implementations,wearable item 508 may include a transponder. Transponder 504 and/or atransponder of wearable item 508 may be configured to provide at leastone linkage point of the living entity (i.e., the dog). The at least onelinkage point may be predefined so as to be associated with a specificlinkage point with respect to a correlation of the linkage points andthe arrangement of linkage points. For example, the at least one linkagepoint defined based on transponder 504 and/or a transponder of wearableitem 508 may be predefined as a linkage point identifying the neck ormiddle of back of the dog. Based on the at least one linkage point,content triggering component 118 may be configured to detect and/oridentify one or more additional linkage points. For example, contenttriggering component 118 may be configured to identify one or moreadditional linkage points using one or more image recognitiontechniques, object recognition techniques, and/or body recognitiontechniques. Based on the arrangement of linkage points, contenttriggering component 118 may be configured to trigger content to bedisplayed based on the living entity. For example, and referring to FIG.5C, exemplary display 510 of an augmented reality environment isillustrated, in accordance with one or more implementations. Exemplarydisplay 510 may include virtual content item 512. Virtual content item512 may be predefined virtual content associated with the dog. Forexample, an owner of the dog may select virtual content item 512 as thevirtual content to be rendered when the dog is visible within the fieldof view of a user. As the dog moves within the field of view of a user(either due to movement by the dog and/or movement by the user withrespect to the dog), an updated image of virtual content item 512 may berendered in the augmented reality environment. As such, the virtualcontent item 512 may be synchronized with the position of thearrangement of linkage points within the field of view of the user sothat virtual content item 512 remains superimposed over the dog as thedog moves within the field of view of the user.

In various implementations, image generation component 120 may beconfigured to generate a new image of virtual content as a user's fieldof view changes. For example, display device 140 may move as a userutilizing display device 140 changes position and/or rotates displaydevice 140. As display device 140 moves, image generation component 120may be configured to automatically generate a new image based on theuser's current field of view and virtual content information obtainedvia content management component 116. Therefore, image generationcomponent 120 may be configured to generate a new image of virtualcontent based at least on a user's current field of view in real-time.In various implementations, image generation component 120 may beconfigured to obtain an indication of an updated position of displaydevice 140 in the real world at a second time and generate an updatedimage of virtual content based on the updated position of the displaydevice 140 at the second time and the user's field of view at the secondtime. Therefore, image generation component 120 may be configured togenerate a first image of virtual content to be displayed at a firsttime based on the field of view of the user at the first time andgenerate a second image of virtual content to be displayed at a secondtime based on the field of view of the user at the second time.

In various implementations, image generation component 120 may beconfigured to generate a new image of virtual content as a living entitymoves within a user's field of view. For example, a living entity maymove with respect to a user utilizing display device 140 causing theposition of the living entity with respect to the user to change, thus,changing the position of the living entity within the user's field ofview. As the living entity moves within the user's field of view, imagegeneration component 120 may be configured to automatically generate anew image based on the current position of the living entity within theuser's field of view. Therefore, image generation component 120 may beconfigured to generate a new image of virtual content based at least onthe position of the living entity relative to a user's gaze inreal-time.

Display control component 122 may be configured to cause an image ofvirtual content to be displayed in an augmented reality environment viadisplay device 140. In various implementations, display controlcomponent 122 may be configured to effectuate transmission ofinstructions to display device 140. In various implementations, displaycontrol component 122 may be configured to generate and/or obtaininstructions causing an image of virtual content to be displayed viadisplay device 140. In some implementations, display control component122 may be configured to cause images of multiple virtual content itemsor multiple sets of virtual content to be displayed in an augmentedreality environment simultaneously via display device 140.

In various implementations, system 100 may be configured to facilitateremote interaction with virtual content depicted in the augmentedreality environment by one or more other users. For example, tofacilitate remote interaction with virtual content, system 100 mayfurther comprise a content management component and/or remoteinteraction component as described in co-pending U.S. patent applicationSer. No. 15/796,716, entitled “SYSTEMS AND METHODS FOR RENDERING AVIRTUAL CONTENT OBJECT IN AN AUGMENTED REALITY ENVIRONMENT,”, thedisclosure of which is hereby incorporated by reference in its entiretyherein.

Electronic storage 130 may include electronic storage media thatelectronically stores information. The electronic storage media ofelectronic storage 130 may be provided integrally (i.e., substantiallynon-removable) with one or more components of system 100 and/orremovable storage that is connectable to one or more components ofsystem 100 via, for example, a port (e.g., a USB port, a Firewire port,etc.) or a drive (e.g., a disk drive, etc.). Electronic storage 130 mayinclude one or more of optically readable storage media (e.g., opticaldisks, etc.), magnetically readable storage media (e.g., magnetic tape,magnetic hard drive, floppy drive, etc.), electrical charge-basedstorage media (e.g., EPROM, EEPROM, RAM, etc.), solid-state storagemedia (e.g., flash drive, etc.), and/or other electronically readablestorage media. Electronic storage 130 may be a separate component withinsystem 100, or electronic storage 130 may be provided integrally withone or more other components of system 100 (e.g., a user device,processor 110, or display device 140). Although electronic storage 130is shown in FIG. 1 as a single entity, this is for illustrative purposesonly. In some implementations, electronic storage 130 may comprisemultiple storage units. These storage units may be physically locatedwithin the same device, or electronic storage 130 may represent storagefunctionality of multiple devices operating in coordination.

Electronic storage 130 may store software algorithms, informationdetermined by processor 110, information received remotely, and/or otherinformation that enables system 100 to function properly. For example,electronic storage 130 may store virtual content information, anindication of virtual content stored and/or accessible by the system,images generated by image generation component 120, sensor information(e.g., orientation information), device information, locationinformation, and/or other information. In some implementations,electronic storage 130 may store a database comprising informationindicating arrangements of linkage points and corresponding states oractions.

Display device 140 may be configured to present virtual content in anaugmented reality environment. In various implementations, displaydevice 140 may be configured to generate light and provide the light toan eye of a user such that the light forms images of the virtual contentconfigured to be perceived in the augmented reality environment as if itwere present in the real world. Display device 140 may include one ormore of a display, one or more sensors, and/or other components.Presentation of virtual content via a display of display device 140 maybe facilitated by control signals communicated to display device 140.For example, display control component 122 may be configured tocommunicate one or more control signals to display device 140. In someimplementations, display device 140 may be configured to present contentindividually to each eye of a user as stereoscopic pairs.

Display device 140 may comprise any device capable of displaying areal-time view of a physical, real-world environment while superimposingimages of virtual content over the real-time view of the physical,real-world environment. As such, display device 140 may comprise anydevice that includes and/or is communicatively coupled to an imagecapturing device (e.g., a camera and/or any other device that includesan imaging sensor) that may be used to capture a view of the real-worldenvironment.

In various implementations, display device 140 may comprise asmartphone, a tablet, a computer, a wearable device (e.g., a headset, avisor, glasses, contact lenses, and/or any other wearable device), amonitor, a projector, and/or any other device configured to presentviews of virtual content in an augmented reality environment. In variousimplementations, display device 140 may include or be associated withone or more speakers for playing one or more sounds associated with avirtual content object. In some implementations, display device 140 maybe arranged on, and/or may comprise part of, a headset (not shown inFIG. 1). When headset is installed on a user's head, the user's gaze maybe directed towards display device 140 (or at least a display of displaydevice 140) to view content presented by display device 140.

A display of display device 140 may include one or more of screen, a setof screens, a touchscreen, a monitor, a headset (e.g., a head-mounteddisplay, glasses, goggles), contact lenses, and/or other displays. Insome implementations, a display may include one or more of atransparent, semi-transparent, reflective, and/or semi-reflectivedisplay component, such as a visor, glasses, and/or contact lenses.Images of virtual content may be presented on the display component suchthat the user may view the images presented on the display component aswell as the real-world through the display component. The virtualcontent may be perceived as being present in the real world. Such aconfiguration may provide an interactive space comprising an augmentedreality environment. By way of non-limiting illustration, display device140 may comprise an AR headset.

Individual sensors of display device 140 may be configured to generateoutput signals. An individual sensor may include an orientation sensor,and/or other sensors (e.g., imaging sensor 150). An orientation sensorof display device 140 may be configured to generate output signalsconveying orientation information and/or other information. Orientationinformation derived from output signals of an orientation sensor maydefine an orientation of display device 140. In some implementations,orientation of display device 140 may refer to one or more of a pitchangle, a roll angle, a yaw angle, and/or other measurements. Anorientation sensor may include an inertial measurement unit (IMU) suchas one or more of an accelerometer, a gyroscope, a magnetometer,Inclinometers, and/or other devices. In various implementations, theorientation of display device 140 may be communicated to imagegeneration component 120 to generate and/or update images of a virtualcontent object to be viewed via display device 140. Imaging sensor 150may be configured to generate output signals conveying a series ofimages depicting a field of view of the user. In variousimplementations, imaging sensor 150 may be physically located withindisplay device 140, physically located separate from display device 140,and/or within any of the other components of system 150. For example,imaging sensor 150 may be physically located within a depth sensingcamera communicatively coupled to display device 140 and/or one or moreother components of system 100.

System 100 may include one or more devices configured to or capable ofproviding haptic features via tactile output. For example, a userdevice, display device 140, and/or one or more other components ofsystem 100 may be configured to vibrate based on one or more parametersdefining haptic features of virtual content. A haptic feature maycomprise one or more effects associated with virtual content observedhaptically. For example, effects observed haptically may comprise one ormore of a vibration, a motion, a temperature, and/or other hapticeffects observed via tactile output. Haptic features may be static ordynamic, and may be haptically observed at a time, over a period oftime, at a location, and/or over a range of locations. Virtual contentinformation defining virtual content may define one or more triggersassociated with one or more haptic features of the virtual content.

Implementations of the disclosure may be made in hardware, firmware,software, or any suitable combination thereof. Aspects of the disclosuremay be implemented as instructions stored on a machine-readable medium,which may be read and executed by one or more processors. Amachine-readable medium may include any mechanism for storing ortransmitting information in a form readable by a machine (e.g., acomputing device). For example, a tangible computer readable storagemedium may include read only memory, random access memory, magnetic diskstorage media, optical storage media, flash memory devices, and others,and a machine-readable transmission media may include forms ofpropagated signals, such as carrier waves, infrared signals, digitalsignals, and others. Firmware, software, routines, or instructions maybe described herein in terms of specific exemplary aspects andimplementations of the disclosure, and performing certain actions.

Although processor 110, electronic storage 130, display device 140, andimaging sensor 150 are shown to be connected to interface 102 in FIG. 1,any communication medium may be used to facilitate interaction betweenany components of system 100. One or more components of system 100 maycommunicate with each other through hard-wired communication, wirelesscommunication, or both. For example, one or more components of system100 may communicate with each other through a network. For example,processor 110 may wirelessly communicate with electronic storage 130. Byway of non-limiting example, wireless communication may include one ormore of the Internet, radio communication, Bluetooth communication,Bluetooth Low Energy (BLE) communication, Wi-Fi communication, cellularcommunication, infrared communication, or other wireless communication.Other types of communications are contemplated by the presentdisclosure.

Although processor 110 is illustrated in FIG. 1 as a single component,this is for illustrative purposes only. In some implementations,processor 110 may comprise multiple processing units. These processingunits may be physically located within the same device, or processor 110may represent processing functionality of multiple devices operating incoordination. For example, processor 110 may be located within a userdevice, display device 140, and/or other components of system 100. Insome implementations, processor 110 may be remote from a user device,display device 140, and/or other components of system 100. Processor 110may be configured to execute one or more components by software;hardware; firmware; some combination of software, hardware, and/orfirmware; and/or other mechanisms for configuring processingcapabilities on processor 110.

Furthermore, it should be appreciated that although the variousinstructions are illustrated in FIG. 1 as being co-located within asingle processing unit, in implementations in processor(s) 110 includemultiple processing units, one or more instructions may be executedremotely from the other instructions.

The description of the functionality provided by the differentcomputer-readable instructions described herein is for illustrativepurposes, and is not intended to be limiting, as any of instructions mayprovide more or less functionality than is described. For example, oneor more of the instructions may be eliminated, and some or all of itsfunctionality may be provided by other ones of the instructions. Asanother example, processor(s) 110 may be programmed by one or moreadditional instructions that may perform some or all of thefunctionality attributed herein to one of the computer-readableinstructions.

Exemplary Flowcharts of Processes

FIG. 6 illustrates a method 600 for rendering a virtual content objectin an augmented reality environment based on a living entity, inaccordance with one or more implementations. The operations of method600 presented below are intended to be illustrative and, as such, shouldnot be viewed as limiting. In some implementations, method 600 may beaccomplished with one or more additional operations not described,and/or without one or more of the operations discussed. In someimplementations, two or more of the operations may occur substantiallysimultaneously. The described operations may be accomplished using someor all of the system components described in detail above.

In some implementations, method 600 may be implemented in one or moreprocessing devices (e.g., a digital processor, an analog processor, adigital circuit designed to process information, a central processingunit, a graphics processing unit, a microcontroller, an analog circuitdesigned to process information, a state machine, and/or othermechanisms for electronically processing information). The one or moreprocessing devices may include one or more devices executing some or allof the operations of method 600 in response to instructions storedelectronically on one or more electronic storage mediums. The one ormore processing devices may include one or more devices configuredthrough hardware, firmware, and/or software to be specifically designedfor execution of one or more of the operations of method 600.

In an operation 602, method 600 may include detecting a living entityand multiple linkage points defined with respect to the living entityvisible within a field of view of a user. The living entity and multiplelinkage points may be detected based on a series of images depicting afield of view of the user obtained from an imaging sensor of a displaydevice. One or more image recognition techniques may be used to detectthe living entity and the multiple linkage points for the living entityvisible within the field of view of the user. In some implementations,operation 602 may be performed by a processor component the same as orsimilar to content triggering component 118 (shown in FIG. 1 anddescribed herein).

In an operation 604, method 600 may include determining an arrangementof the multiple linkage points. The arrangement of the multiple linkagepoints defines the relative position of the linkage points to eachother. In some implementations, a state of the living entity or anaction of the living entity may be identified based on the arrangementof the linkage points. In some implementations, operation 604 may beperformed by a processor component the same as or similar to contenttriggering component 118 (shown in FIG. 1 and described herein).

In an operation 606, method 600 may include obtaining virtual contentinformation based on the arrangement. Based on the arrangement of thelinkage points, virtual content information defining particular virtualcontent that is to be displayed when the arrangement is present may beobtained. The virtual content information may define a correlationbetween the arrangement and a reference frame of the virtual content.The virtual content information may be obtained from electronic storage,from one or more devices of the user, one or more connected devices(e.g., a device of a living entity visible within a field of view of theuser), and/or via a network (e.g., via the Internet, cloud storage,and/or one or more other networks). In some implementations, operation606 may be performed by a processor component the same as or similar tocontent management component 116 (shown in FIG. 1 and described herein).

In an operation 608, method 600 may include generating an image of thevirtual content item to be displayed in the augmented realityenvironment based on the living entity. The image of the virtual contentitem may be generated based at least on the virtual content informationand the field of view of the user. A user's field of view may be definedbased on orientation information, location information, and/or otherinformation. Updated images of virtual content may automatically begenerated as a user's field of view changes or as a living entity moveswithin a user's field of view, thus changing the depiction of thevirtual content in the augmented reality environment based on thereference frame of the virtual content and its correlation to theposition of the linkage points. In some implementations, operation 608may be performed by a processor component the same as or similar toimage generation component 120 (shown in FIG. 1 and described herein).

In an operation 610, method 600 may include causing the image of thevirtual content item to be displayed in the augmented realityenvironment via the display device. In some implementations, updatedimages of virtual content may be automatically displayed when generated(e.g., as a user's field of view changes or as a living entity moveswithin a user's field of view). In some implementations, operation 610may be performed by a processor component the same as or similar todisplay control component 122 (shown in FIG. 1 and described herein).

For purposes of explanation, numerous specific details are set forth inorder to provide a thorough understanding of the description. It will beapparent, however, to one skilled in the art that implementations of thedisclosure can be practiced without these specific details. In someinstances, modules, structures, processes, features, and devices areshown in block diagram form in order to avoid obscuring the description.In other instances, functional block diagrams and flow diagrams areshown to represent data and logic flows. The components of blockdiagrams and flow diagrams (e.g., modules, blocks, structures, devices,features, etc.) may be variously combined, separated, removed,reordered, and replaced in a manner other than as expressly describedand depicted herein.

Reference in this specification to “one implementation”, “animplementation”, “some implementations”, “various implementations”,“certain implementations”, “other implementations”, “one series ofimplementations”, or the like means that a particular feature, design,structure, or characteristic described in connection with theimplementation is included in at least one implementation of thedisclosure. The appearances of, for example, the phrase “in oneimplementation” or “in an implementation” in various places in thespecification are not necessarily all referring to the sameimplementation, nor are separate or alternative implementations mutuallyexclusive of other implementations. Moreover, whether or not there isexpress reference to an “implementation” or the like, various featuresare described, which may be variously combined and included in someimplementations, but also variously omitted in other implementations.Similarly, various features are described that may be preferences orrequirements for some implementations, but not other implementations.

The language used herein has been principally selected for readabilityand instructional purposes, and it may not have been selected todelineate or circumscribe the inventive subject matter. Otherimplementations, uses and advantages of the invention will be apparentto those skilled in the art from consideration of the specification andpractice of the invention disclosed herein. The specification should beconsidered exemplary only, and the scope of the invention is accordinglyintended to be limited only by the following claims.

What is claimed is:
 1. A system configured to utilize living entities asmarkers for virtual content viewed in an augmented reality environment,the system comprising: a display device configured to superimpose imagesof visual virtual content over a real-world view of a user to create avisual effect of the augmented reality environment being present in areal world, wherein the real-world view of the user is an outlook of thereal world from the point of view of the user; one or more physicalcomputer processors configured by computer readable instructions to:detect a living entity within a field of view of the real-world view ofthe user, the living entity being a separate and discrete entity fromthe user, wherein the field of view is the area that comprises thereal-world view of the user, wherein detecting the living entity visiblewithin the field of view includes: obtaining a first image of the fieldof view visible via the display device; obtaining a second image of thefield of view visible via the display device; and detecting the livingentity visible within the field of view based on a comparison of thefirst image and the second image; detect multiple linkage points for theliving entity; determine an arrangement of the multiple linkage points,wherein the arrangement defines the relative position of each of thelinkage points to each of the other linkage points of the multiplelinkage points; dynamically determine virtual content information basedon the arrangement, wherein the determined virtual content informationdefines (i) a virtual content item to be displayed when the arrangementis present and (ii) a correlation between the arrangement and areference frame of the virtual content item; obtain the determinedvirtual content information; generate an image of the virtual contentitem to be displayed in the augmented reality environment based on theliving entity, wherein the image of the virtual content item isgenerated based at least on the virtual content information and thefield of view; and cause the image of the virtual content item to bedisplayed in the augmented reality environment so that the image of thevirtual content item is superimposed over the living entity in thereal-world view of the user such that the user views the image of thevirtual content item in the augmented reality environment via thedisplay device.
 2. The system of claim 1, wherein the arrangement isdetermined at a first point in time, and wherein the one or moreprocessors are further configured to: determine a second arrangement ofthe multiple linkage points at a second point in time, wherein thesecond arrangement of the multiple linkage points is different from thearrangement of the multiple linkage points at the first point in time;identify an action of the living entity based on the first arrangementand the second arrangement; obtain second virtual content informationdefining a second virtual content item to be displayed when the actionis identified; generate an image of the second virtual content item tobe displayed in the augmented reality environment based on the livingentity; and cause the image of the second virtual content item to bedisplayed in the augmented reality environment so that the image of thesecond virtual content item is superimposed over the living entity inthe real-world view of the user such that the user views the image ofthe second virtual content item in the augmented reality environment viathe display device.
 3. The system of claim 2, wherein the second virtualcontent item comprises an animation associated with the action.
 4. Thesystem of claim 1, wherein the one or more processors are furtherconfigured to: determine an identification of the living entity thatdistinguishes the living entity from other living entities, wherein thevirtual content information is obtained based on the identification ofthe living entity.
 5. The system of claim 4, wherein the identificationof the living entity comprises an indication of a type of living entityand/or a group of living entities.
 6. The system of claim 1, wherein aposition of each of the multiple linkage points in the real worlddefines the reference frame of the virtual content item with respect tothe real world and the living entity.
 7. The system of claim 1, whereinthe image of the virtual content item is generated based further on aposition of the display device in the real world and the position ofeach of the multiple linkage points in the real world.
 8. The system ofclaim 1, wherein the image of the virtual content item is generatedbased further on the size of the arrangement of the multiple linkagepoints within the field of view of the user.
 9. The system of claim 1,wherein the field of view is defined based on location information andorientation information, the location information indicating at least acurrent location associated with the display device, and the orientationinformation indicating at least a pitch angle, a roll angle, and a yawangle associated with the display device.
 10. The system of claim 1,wherein to detect the living entity and the multiple linkage pointsdefined with respect to the living entity, the one or more processorsare further configured to: receive a signal from a transponder of theliving entity, wherein the signal from the transponder indicates alocation of the transponder and includes triggering information thatidentifies virtual content to be displayed in the augmented realityenvironment based on the living entity; obtain virtual contentinformation based on the triggering information; detect at least a firstlinkage point for the living entity based on the transponder, whereinthe signal from the transponder defines the position of the firstlinkage point with respect to the living entity; and detect one or moreadditional linkage points based on the position of the first linkagepoint with respect to the living entity, wherein the multiple linkagepoints include at least the first linkage point and the one or moreadditional linkage points.
 11. A method of utilizing living entities asmarkers for virtual content viewed in an augmented reality environment,the method comprising: detecting a living entity within a field of viewof a real-world view of a user, the living entity being a separate anddiscrete entity from the user, wherein the field of view is the areathat comprises the real-world view of the user, wherein the real-worldview of the user is an outlook of a real world from the point of view ofthe user, wherein detecting the living entity visible within the fieldof view comprises: obtaining a first image of the field of view visiblevia the display device; obtaining a second image of the field of viewvisible via the display device; and detecting the living entity visiblewithin the field of view based on a comparison of the first image andthe second image; detecting multiple linkage points for the livingentity; determining an arrangement of the multiple linkage points,wherein the arrangement defines the relative position of each of thelinkage points to each of the other linkage points of the multiplelinkage points; dynamically determining virtual content informationbased on the arrangement, wherein the determined virtual contentinformation defines (i) a virtual content item to be displayed when thearrangement is present and (ii) a correlation between the arrangementand a reference frame of the virtual content item; obtaining thedetermined virtual content information; generating an image of thevisual virtual content item to be displayed in the augmented realityenvironment based on the living entity, wherein the image of the virtualcontent item is generated based at least on the virtual contentinformation and the field of view; and causing the image of the virtualcontent item to be displayed in the augmented reality environment sothat the image of the virtual content item is superimposed over theliving entity in the real-world view of the user such that the userviews the image of the virtual content item in the augmented realityenvironment via a display device, wherein the display device isconfigured to superimpose images of visual virtual content over thereal-world view of the user to create a visual effect of the augmentedreality environment being present in the real world.
 12. The method ofclaim 11, wherein the arrangement is determined at a first point intime, the method further comprising: determining a second arrangement ofthe multiple linkage points at a second point in time, wherein thesecond arrangement of the multiple linkage points is different from thearrangement of the multiple linkage points at the first point in time;identifying an action of the living entity based on the firstarrangement and the second arrangement; obtaining second virtual contentinformation defining a second virtual content item to be displayed whenthe action is identified; generating an image of the second virtualcontent item to be displayed in the augmented reality environment basedon the living entity; and causing the image of the second virtualcontent item to be displayed in the augmented reality environment sothat the image of the second virtual content item is superimposed overthe living entity in the real-world view of the user such that the userviews the image of the second virtual content item in the augmentedreality environment via the display device.
 13. The method of claim 12,wherein the second virtual content item comprises an animationassociated with the action.
 14. The method of claim 11, the methodfurther comprising: determining an identification of the living entitythat distinguishes the living entity from other living entities, whereinthe virtual content information is obtained based on the identificationof the living entity.
 15. The method of claim 14, wherein theidentification of the living entity comprises an indication of a type ofliving entity and/or a group of living entities.
 16. The method of claim11, wherein a position of each of the multiple linkage points in thereal world defines the reference frame of the virtual content item withrespect to the real world and the living entity.
 17. The method of claim11, wherein the image of the virtual content item is generated basedfurther on a position of the display device in the real world and theposition of each of the multiple linkage points in the real world. 18.The method of claim 11, wherein the image of the virtual content item isgenerated based further on the size of the arrangement of the multiplelinkage points within the field of view of the user.
 19. The method ofclaim 11, wherein the field of view is defined based on locationinformation and orientation information, the location informationindicating at least a current location associated with the displaydevice, and the orientation information indicating at least a pitchangle, a roll angle, and a yaw angle associated with the display device.20. The method of claim 11, wherein detecting the living entity and themultiple linkage points defined with respect to the living entitycomprises: receiving a signal from a transponder of the living entity,wherein the signal from the transponder indicates a location of thetransponder and includes triggering information that identifies virtualcontent to be displayed in the augmented reality environment based onthe living entity; obtaining virtual content information based on thetriggering information; detecting at least a first linkage point for theliving entity based on the transponder, wherein the signal from thetransponder defines the position of the first linkage point with respectto the living entity; and detecting one or more additional linkagepoints based on the position of the first linkage point with respect tothe living entity, wherein the multiple linkage points include at leastthe first linkage point and the one or more additional linkage points.